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[57] ABSTRACT 

An image morphological processing system is formed 
by a cascade of a plurality of transformation stages. A 
pair of handshake data flow control lines couple each 
pair of adjacent stages. One line carries a first signal 
indicating when the previous stage has data available at 
its output and the other line carries a second signal 
which designates when the subsequent stage is able to 
receive data from the previous stage. In order that first 
and second signals can propagate in an orderly manner 
through a long cascade of stages, each signal is delayed 
by one cycle of the signal which clocks image data 
through the cascade. The delayed signal is then coupled 
to the next stage along the cascade. By controlling the 
propagation of the control signals to correspond to that 
of the image data the integrity of the data is maintained. 
Each stage also includes a circuit which detects when 
an idempotent transformation is performed by that 
stage. 

14 Claims, 6 Drawing Sheets 
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system which feed the image data into the pipeline or 
PIPELINE IMAGE PROCESSOR which receive the final resultant image enter a state in 

which they cannot interface with the pipeline, the integ- 
The present invention relates to two dimensional nty of the processing fails. Specifically, if the input of 
image processing techniques for pattern and feature 5 data to the pipeline ceases, continued pipeline operation 
recognition, and more particularly to such techniques w iU process invalid pixel data producing an invalid 
utilizing a series of pixel transformations based on resultant image. Similarly, if the output portion of the 
neighborhoods of pixels. system is unable to receive data from the pipeline, con- 

BACKGROUND OF THE INVENTION 10 ***td operation will result in processed image data 

1U being lost. These types of errors also may occur if an 
As automated assembly equipment and robots be- individual morphological processor in the pipeline en- 
come more sophisticated, it is desirable to add the sense counts a fault condition and the other processors 
of vision to these devices. This would enable the equip- operating. Therefore, a mechanism is required 

ment to locate the position of an object being manufac- tQ thc proccssors whcn a f auU condition exists 
tured, as well as to inspect the object for the presence of TS d vidc ^ orderl c^on of processing which 
components and the proper location and sue of specific main ^ ains data intcg rity. 
features. To this end, various image processing systems 

have been devised which produce a two dimensional SUMMARY OF THE INVENTION 

video signal image of the object for analysis. processing system has a number of proces- 

A previous image processing technique ^fomed 20 £ * ^ Each stage 

the onanal video sisnal image into a totally different „ ° J ^ . r v * • 

one?n which the desired features could be more readily ^rms a predefined <™f«^ on imput un^e 
analyzed. In preparing an image for transformation, a data an A d formed image data o the next 

video signal imaje w* initially digitized into a binary ^ge ; A set of input data flow control signal lines con- 
image, iiwhich each picture element (pixel) is repre- 25 *«* between each stage and an input device which 
sented by a single bit so that the pixel is either black or Provides the input image data to that stage. One of these 
white. Each pixel of the binary image is then trans- lines carries a signal from the input device indicating 
formed according to a definite rule specifying a new when that device has data available to send and the 
value for the particular pixel in terms of its old value other line carries a signal which designates when the 
and the old values of the pixels in a predefined neigh- 30 stage is ready to receive data. A set of output data flow 
borhood around it. For example, the neighborhood may control signal lines connect each stage to an output 
consist of three-by-three matrix of pixels with the pixel device which receives the transformed image data from 
being transformed located in the center of the matrix. that stage. One of the lines in the second set carries a 
The binary values of the nine neighborhood pixels are signal which indicates when the stage has image data 
then evaluated to determine the new value for the cen- 35 ready to output. The other line receives a signal repre- 
tral pixel. In a simple case, if all nine pixels are white, senting the availability of the output device to receive 
the central pixel is set to white in the transformed im- the transformed image data from the stage. The input 
age; otherwise it is assigned a black level. The affect of and output devices can be another stage of the pipeline 
this transformation is that the pixels at the edge of white or devices coupled to either end of the pipeline, 
areas become black. This case is referred to as "white 40 a first circuit within each stage processes the input 
erosion" since the white areas of the image become data flow signal. This first circuit delays the signal 
smaller and black areas become larger. An inverse which indicates when the input device has data and 
transformation, referred to as **white dilation", exists applies the delayed signal to the line which carries the 
where if certain neighborhood pixels arc black, the signal indicating when the stage has data available to 
transformed value of the central pixel is white. This 45 out put A second circuit within each stage delays the 
later transformation tends to expand white areas of the signaJ indicative of when the availability of the output 
image and decrease the black areas. This type of neigh- device to receive data from the stage. The delayed 
borhood transformation is generically known as ,4 math- signa] from thc ^^d c b cu [ t is coupled to the line 
ematical morphological processing" and is described in which carries a signal designating the availability of the 
the book "Image Analysis and Mathematical Morphol- 50 s tQ receivc imagc d ata. Both the first and second 
ogy" by Jean Serra published by Academic Press Inc., ^ ^ ^ a mcchanism for controlling the 

1982. Reference is also made to US. Pat. No. 3,805,035 transformation in response to the signals from the 

entitled "Device for the logical Analysis of Textures * ^ dcviccs tively . 

In using this morphological image Processing tech- » h provide an image processor 

nique, the transformation rule is oftea reapplied to the 55 * . > for use as a stage of a pipelme image 

resultant image to further transform the original image. Z^^na^fZr! 
A number of these transformation iterations may be processing sysicm. 

itSteS £ order to resolve the image into one from * n order to accomplish this general object, the pres- 
^cSrmation regarding the relevant features can 'nt mvenUonprovides a pair of data flow signals which 
be more easily extract*. ByOie user defining the trans- 60 control the flow of data through Ute pipehne. A any 
formation rule and the number of processing iterations, ?ven point, one of these : sigmds uidicates the av^ 
a given feature in the image can be resolved into a «y of data upstream in the pipelme : cascade. The other 
unique image clement, such as a point or a line in the control signal indicates the availability of devices 
resultant image. downstream from the given point to receive data. 

As repetitive processing is often necessary, it is desir- 65 Another object is to provide a predefined mechanism 
able. to connect a number of morphological processors to propagate these control signals along the pipeline in 
in a pipeline to speed up the transformation into the final order to have an orderly control of the image transfer- 
version of the image. However, if the portions of the mations. 
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Yet another object of the present invention is to pro- The essence of the present invention involves the 
vide a way of determining whether an image transfor- image processing pipeline 14 and its data flow hand* 
mation performed by a stage is idempotent shake control signals. This processor performs a trans- 

BRIEF DESCRIPTION OF THE DRAWINGS , ^Zl^t^^^ 1 ^ 

FIG. 1 is a general diagram of a generic image pro- the spatial relationship of the pixels for a portion of the 

cessing system incorporating the present invention; raster scan video image stored in the first memory 12. 

FIG. 2 is a spatial depiction of the pixels in a section Each pixel is defined by line and column coordinates in 

of a video image; . the two dimensional image, e.g. the first pixel in the first 

FIG. 3 shows the details of the pipeline image proces- 10 line is pixel (0,0). In digitizing the output of the video 

sor of FIG. 1; camera, the phase of the clock signal for the ADC 11 is 

FIG. 4 is a block schematic diagram of one stage of shifted one half pixel period at the beginning of every 

the pipeline image processor; other scan line. This shift offsets the pixels in the odd 

FIG. 5 represents the details of a neighborhood selec- lines from those in the even lines to produce a "hexago- 

tor for a stage of the pipeline image processor; IS nal" image frame. This allows a hexagonal neighbor- 

FIG. 6 is a representation of the portion of the image hood to be defined as a central pixel to be transformed 

of FIG. 2 illustrating the temporal relationship of the and the six pixels adjacent to it. One such neighborhood 

pixels during image processing; for transforming pixel 1,2 is represented by the cross- 

FIG. 7 is a diagram of a circuit which processes inter- hatched area on FIG. 2. Each pixel is also a member of 

stage stage data flow control signals; and 20 the neighborhoods created to transform each of its six 

FIG. 8 is a waveform diagram of the interstage data adjacent pixels. As is apparent from this figure, in order 

flow control signals. to transform a given pixel, the values of pixels in the 

DESCRIPTION OF THE INVENTION g^™* mbsaiMnt *»» linCS ° f the m,igti mUSt 

FIG. 1 illustrates a generic image processing system 8 25 The details of the image processing pipeline 14 for 
within which is incorporated a morphological transfor- evaluating a neighborhood of seven hexagonally related 
mation image processor according to the present inven- pixels is shown in FIG. 3. The pipeline 14 is structured 
tion. Reference numeral 10 designates a conventional around three morphological processors 21, 22, and 23 
video camera such as one which produces a standard which are cascaded together, however additional mor- 
RS-170 video signal. For example, the video signal 30 phological processors can be provided. Each of the 
represents a raster scan video image having 256 scan morphological processors has three data inputs, LA, 
lines with 256 picture elements (commonly referred to LB, and LC, for receiving image data from the previous 
as pixels) in each line. The video signal from the video device in the cascade. For example, the three data in- 
camera is coupled to an analog-to-digital converter puts, LA, LB, and LC of the first morphological pro- 
(ADC) 11 which produces digitized representation of 35 cesser 21 receive data from the first memory 12 repre- 
the luminance level of each pixel of the video image. senting the pixels in the current scan line and its two 
Depending upon the type of image processing to be predecessor scan lines respectively. Specifically, the 
performed by this system, the ADC 11 can be config- most significant bit line of the six bit parallel data bus 13 
ured to produce either a six bit digital representation of from the first memory 12 is coupled directly to one of 
the pixel's gray scale luminance or a single bit represen- 40 the LA inputs for the first morphological processor 21. 
tation (white or black) of each pixel in a binary image. The remaining five lines of data bus 13 are coupled by 

The digitized pixels are stored in a first memory 12 a set of five tri-state data buffers 20 to the LA input, 
for non-real time processing, although real time pro- Depending on whether a gray scale or a binary image is 
cessing is feasible. The data output of the first memory to be processed, buffers 20 are controlled so that six bits 
12 is coupled by a six-bit parallel data bus 13 to the input 45 or a single bit, respectively, are sent into the LA input, 
of a image processing pipeline 14 which performs the The six data lines 19 which are connected to the LA 
morphological transformation of the image. Two data input of the first morphological processor 21 also are 
flow control lines, INPUT READY and INPUT coupled by a first shift register 24 to the LB input, and 
VALID, extend between the first memory and the pipe- by a series connection of the first shift register 24 and a 
line processor 14. The first memory 12 produces an 50 second shift register 25 to the LC input. Each shift 
active INPUT VALID signal when it has data available register 24 and 25 has 256 stages which are six bits wide 
for the image processing pipeline 14. When the image thereby providing a delay equal to one horizontal line 
processing pipeline 14 is able to receive data, it asserts scan period of the video image. Alternatively, the shift 
an active INPUT READY signal. The data output from registers can have a programmable length thereby pro- 
image processing pipeline 14 is coupled to the input of 55 viding greater flexibility in configuring the pipeline. As 
a second memory 15 which stores the transformed ver- a result of the delays provided by the shift registers, the 
sion of the image. Two handshake control lines, OUT pixels for three consecutive scan lines are simulta- 
READY and OUT VALID, extend between the image neously applied to the inputs LA, LB, and LC of the 
processing pipeline 14 and the second memory 15 to first morphological processor 21. The shift registers 24 
control the flow of data therebetween. 60 and 26 and the morphological processor 21 receives a 

The data output of the second memory 15 is con- clock signal from the system clock 17. The morphologi- 
nected to the input of an image analyzer circuit 16 cal processor 21 generates a hold signal which is cou- 
which can be any of several well known types For pled to the shift registers 24 and 26 to halt the shifting of 
example, the image analyzer can be of the type de- data. 

scribed in U.S. Pat No. 3,449,586. A system clock 17 65 The INPUT VALID control line is coupled to the 
provides the necessary timing signals for the compo- first morphological processor 21 and carries a signal, 
nents of the image processor system to control their hereinafter designated IV AL, which indicates when the 
operation and the flow of data through the system. first memory 12 has pixel data for that processor. The 
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first morphological processor 21 generates a signal Tiers 40-42, respectively. The bit line LC5 for the sec- 
IRDY on the INPUT READY control line when it is ond previous video scan line data feeds a cascade con- 
capable of receiving data from the first memory. All of nection of flip-flops G, H, and I. The Q outputs of flip- 
the morphological processors 21-23 are connected to a flops G and H are connected to the inputs of a third line 
control line, designated BINARY, which carries a sig- 5 multiplexer 43 while a fourth multiplexer 44 receives 
nal indicating whether a gray scale or a binary image is the Q outputs from the H and I flip-flops. The outputs of 
being processed. An output signal is produced on an- the line multiplexers 38, 39, 43, and 44 and of the output 
other common control line, designated BUSY, by the buffer amplifiers 40, 41, and 42 form a seven bit output 
processors 21-23 when they are busy performing the on lines OB0-OB6. 

image transformation. The operation of the shift regis- 10 With reference to FIGS. 2, 5, and 6, the neighbor 
ters and morphological processors is referenced to a selectors 30-35 receive the pixel data for three consecu- 
common clock signal from the system clock 17. tive lines and sequentially output the data for the sets of 

The output from the first morphological processor seven pixels which form the image neighborhoods. 
21, representing the results of the first transformation of Because the system is designed for a hexagonal image 
the image, is coupled directly to the LA input of the 15 and a hexagonal neighborhood, the pixel data signals 
second morphological processor 22 and by third and must be processed differently by the selectors depend- 
fourth shift registers 26 and 27 to the LB and LC inputs ing upon whether the pixel being transformed is in an 
of that subsequent processor. The first processor 21 odd or an even numbered scan line. The reason for a 
generates an output signal OVAL when it has valid difference in processing will become apparent through 
transformed image data to output This output signal is 20 a description of how the two neighborhoods high- 
coupled to the IVAL signal input of the second mor- lighted in FIG. 2 are handled, 
phological processor 22. Similarly, this second proces- As previously described, the clocking signal used for 
sor 22 generates a signal IRDY when it is ready to digitizing the odd scan lines is one-half pixel period out 
receive input data. This signal is applied to the output of phase from the clock signal used to digitize the even 
ready ORDY signal input of the first morphological 25 scan lines. Therefore, the digitized pixels for adjacent 
processor 21 to indicate that the next stage of the pipe- lines have the spatial relationship depicted in FIG. 2. 
line can accept data. However, when these pixels are clocked out of the first 

The second morphological processor 22 is coupled to memory 12 through the shift registers 24-29 and the 
the third morphological processor 23 by the same type morphological processors 21-23, each line is clocked by 
of connections as exist between the first and second 30 a signal which is in phase with the clock signal for all of 
morphological processors 21 and 22. Shift registers 28 the other scan lines. Therefore, the data for three adja- 
and 29 are used at the LB and LC inputs of the third cent scan lines arrives at the processor inputs LA, LB, 
stages. Depending upon the number of pipeline stages, and LC in unison, temporally converting the hexagonal 
the outputs of the third morphological processor 23 are image of FIG. 2 into a rectangular image as shown in 
coupled either to a subsequent stage or to the second 35 FIG. 6. This conversion alters the spatial and temporal 
memory 15. relationship of the pixels in the neighborhoods and more 

The circuitry for each of the morphological proces- importantly, the relationship of the seven neighborhood 
sors 21-23 is identical tt> that shown in FIG. 4. Each pixels is different depending upon whether the central 
parallel data bit line of the three image line data inputs, pixel is in an even or an odd line. 
LA, LB, and LC, is coupled to a separate neighbor 40 For example, with reference to the neighborhood 
selector 30-35. For example, the most significant data centered about pixel 1,2 in FIGS. 2 and 6. The conver- 
bit line (LA5, LB5, and LC5) of the three image line sion to a rectangular image places these neighboring 
data inputs is coupled to an input of the first neighbor pixels within a three-by-three pixel array denoted by 
selector 30. The next most significant data bit line of heavy lines around pixel (1,2) in FIG. 6. This array 
input LA, LB, and LC are coupled to the inputs of the 45 corresponds to the threc-byrthree array of pixels stored 
second neighbor selector 31, and so onrThe neighbor in the flip-flops of the neighbor selectors 30-35 of the 
selectors 31-35 collectively receive the pixel data for morphological processor. When the data for central 
the three consecutive scan lines and temporarily select pixel (1,2) is stored in the central flip-flop E, the remain- 
and store the data from the seven pixels of each neigh- ing neighborhood pixel values are stored in flip-flops A, 
borhood. 50 B, D, F, G, and H. A control circuit 45 within each 

Circuit for the first neighbor selector 30 is shown in neighbor selector 30-35 emits a signal designated ODD- 
FIG. 5, it being understood that the other selectors /EVEN indicating whether the central pixel is on an 
32-35 have identical circuits. The neighbor selector odd or an even scan line. In the example for central 
circuit 30 includes nine flip-flops (F/F) designated A-I pixel (1,2) on an odd scan line, the ODD/EVEN signal 
which store a bit of the data for a three-by-three array 55 causes the line multiplexers 38, 39, 43, and 44 to couple 
of adjacent pixels. The most significant input bit line the outputs from flip-flops A, B, G, and H onto output 
LA5 from the LA input is coupled to the data input of lines OBo, OBj, OB5, and OB6, respectively. The out- 
the A flip-flop whose Q output is coupled to the data puts of flip-flops D, E, and F always represent a neigh- 
input of the B flip-flop. The data input of the C flip-flop borhood pixel and are therefore permanently coupled to 
is connected to the Q output of the B flip-flop. The Q 60 output lines OB2, OB3, and OB4. respectively. As a 
outputs of the A and B flip-flops are connected to the result, the output lines from the neighborhood selector 
inputs of a first line multiplexer 38 and the Q outputs of represent data for the pixels in the neighborhood cross 
the B and C flip-flops connected to the inputs of a sec- hatched in FIG. 6. 

ond line multiplexer 39. . When the pixel being transformed lies in an even line, 

The bit line LB5 from the previous video scan line 65 such as pixel (2,6), the conversion from a hexagonal to 
feeds a similar cascade connection of the D, E, and F a rectangular image translates the seven neighborhood 
flip-flops. However, the Q outputs of the. D, E, and F pixels into a different relationship in the three-by-three 
flip-flops are coupled to tri-state output of buffer ampli? array as shown by the stippled pixels in FIG. 6. As a 
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result, when value of this pixel (2,6) is stored in flip-flop 
E of the neighborhood selectors 30-35, the values for 
the other pixels of its neighborhood will be stored in 
flip-flops B, C, D, F, H, and I. This is a different set of 
flip-flops from those for an odd scan line. The ODD- 5 
/EVEN signal now causes the line multiplexers 38, 39, 
43, and 44 to select the outputs from flip-flops B, C, H, 
and I, respectively. Therefore, the output lines OB- 
0-OB6 of the neighborhood selector will contain the 
pixel data from flip-flops B, C, D, E, F, H, arid I when 10 
the pixel being transformed is on an even scan line. A 
VALID output signal is generated by the control cir- 
cuit 45 whenever data is available at the outputs OB- 
0-OB6 of the neighbor selector. 

When the pixel being transformed is on the edge of 15 
the image, some of the neighborhood pixel locations 
will be "off the image' 1 and data will not be available for 
the flip-flops in the neighbor selector which correspond 
to those pixel locations. The control circuit 45 recog- 
nizes this condition and issues reset signals to those 20 
corresponding flip-flops to force their Q outputs to 
zero. For example, when the pixel being transformed, 
i.e. the central one in the neighborhood, is on the bot- 
tom line of the image flip-flop, A, B, and C will be reset 
to produce zeroes at their Q outputs. At this time, there 25 
will not be valid image data at the LA inputs. Alterna- 
tively, these flip-flops could receive set signals to force 
their outputs to one. 

In order to produce the ODD/EVEN and flip-flop 
reset signals, the control circuit 45 receives several 30 
input control signals, designated clock, BZ and PAR. 
The parity signal PAR designates whether the pixels 
being processed are on an odd or even scan line. The 
morphological processors 21-23 can be used not only to 
transform an entire image but also a portion of an image. 35 
In this latter case, the processors must know whether 
the first scan line of that portion is odd or even. The 
parity signal also indicates the end of a scan line or the 
end of the line within the defined image portion, so that 
the corresponding flip-flops can be reset at that image 40 
edge. The parity signal PAR is produced by the output 
of a parity multiplexer 46 which selects the signal from 
one of two inputs BPAR or GPAR depending on 
whether a signal B/G indicates a binary or a gray scale 
image is being processed. The control circuit 45 also 45 
receives a busy signal BZ from a busy multiplexer 47 
which similarly selects between input signals BBZ and 
GBZ depending on the type of image. The BZ signal 
indicates the beginning and end of the portion of the 
image to be processed and is used to indicate when a 50 
central pixel is on a horizontal edge of the portion. In 
addition, the BBZ and BPAR signals are coupled 
through a delay circuit 48 to produce two output signals 
OBZ and OPA when binary image processing is occur- 
ring. The.selection of the different control signals and 55 
their effects on the neighbor selector's operation will 
become apparent is a later section which describes the 
overall operation of the morphological image processor 
21. 

Referring again to FIGS. 3 and 4, the morphological 60 
processor 21 depicted therein can be configured to 
process either binary or gray scale images. Many of the 
components of the processor which are downstream 
from the neighbor selectors 30-35 are employed in the 
processing of only one type of these images. Therefore, 65 
the remaining sections of the morphological processor 
21 are best described, in relation to the processing of 
each type of image. 
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When a binary image is being processed, only a single 
bit for each pixel is fed into each morphological proces- 
sor 21-23. With respect to the first such processor 21 in 
the binary mode, the data buffers 20 on input bus 13 are 
rendered non-conductive so that only the most signifi- 
cant bit line of the bus is coupled to input LAS. The 
LB5 and LC5 inputs receive delayed versions of the 
least significant bit signal from the first two shift regis- 
ters 24 and 25. Only the first neighbor selector 30 re- 
ceives the original image pixel data from the first mem- 
ory 12, the remaining neighbor selectors 31-35 are con- 
nected in a cascade to repeatedly apply a transformation 
rule to the image. 

The seven output bits OB0-OB6 from the first neigh- 
bor selector 30 represent the binary values of the seven 
pixels in the neighborhood of the pixel being trans- 
formed at any given time. These output bits are coupled 
via a first pixel bus spur 50 to the address input of a first 
look-up-table (LUT) memory 60 having 128 storage 
locations. Each unique combination of the seven pixel 
values in the neighborhood addresses a location in the 
look-up-table memory that contains the single bit trans- 
formation value for the central pixel in the neighbor- 
hood. For example, in order to perform an erosion of 
white image areas, the storage location (1111111) in 
look-up-table memory 60 contains a one (a white level) 
and all other locations contains a zero (a black level). 
This transformation result bit is coupled from the look- 
up-table memory 60 by conductor 71 to a tri-state buffer 
amplifier 56 which is enabled in the binary mode by the 
B/G signal from a processor control circuit 70. The 
output of the buffer amplifier 56 is connected to the 
LA4 input of the second neighbor selector 31. The 
signal at input LA4 is coupled by two of the data lines 
19 and the first and second shift registers 24 and 25 to 
the LB4 and LC4 inputs. This coupling of the LA4, 
LB4, and LC4 inputs enable three scan lines of the 
image transformed by the first look-up-table memory 60 
to appear at these inputs. The second neighbor selector 
31 and its associated second look-up-table memory 61 
perform another transformation on the binary image. 
The remaining cascaded pairs of neighbor selectors 
32-35 and look-up-table memories 62-65 perform subse- 
quent image transformation iterations. Each pair of a 
neighbor selector and a look-up-table memory forms a 
cascaded transformation section. 

In the binary mode, the neighbor selector responds to 
the BBZ busy and the BPAR parity signals as selected 
by multiplexers 46 and 47. As the image data for each 
line propagates through each section of this cascade, the 
BBZ BUSY and BPAR parity signals also propagate. 
These signals are delayed by delay circuits 48 in each 
neighbor selector 30-35 to compensate for the propaga- 
tion delay of the image data. 

By loading proper data in the look-up-table memories 
60-65, different transformations can be performed by 
each section of the cascade. Data can even be loaded 
which does not transform the image at a given cascade 
section i.e. all six sections do not have to perform a 
transformation. A central processing unit interface 
(CPU) 49 couples the morphological processor 21 to 
the microcomputer 18 of the image processing system 
so that the transformation data can be downloaded and 
stored in the respective look-up-table memories 60-65. 
For this purpose the CPU 49 is coupled to the look-up- 
table memories by an address bus 57 and a data bus 59. 
In order to simplify the illustration of the morphologi- 
cal processor in FIG. 4, convention control signal lines, 
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which would be necessarily obvious to one skilled in the mode. Therefore, the buffer amplifiers that couple the 

art, have been omitted. output of each memory to the LA input of a neighbor 

The output of the last look-up-table memory 65 is selector 31-35 (e.g. buffer 56) are placed in their tri- 
coupled by line 58 to an input of an arithmetic logic unit state output mode. The pixel bus spurs 50-55 from the 
(ALU) 66. The. ALU has a set of output lines 67, onto 5 output of each neighbor selector 30-35 are combined 
the most significant bit line 67' of which the single data into a central pixel bus 72. The central pixel bus 72 
bit from the last look-up-table memory 65 is coupled. A couples the neighbor selectors 30-35 to circuits 75 and 
signal from a processor control circuit 76 enables a 76 which detect the two neighborhood pixels having 
buffer amplifier 68 on this output line 67 r coupling the the lowest and greatest gray scale values respectively, 
data to the pixel output of the morphological image 10 With respect to the circuit 76 which detects the great- 
processor 21. Buffer amplifiers 69 on the five remaining est valued pixel, the six bit lines carrying the gray scale 
pixel output lines are non-conductive in the binary value for one of the neighborhood pixels are coupled 
image mode. from the central pixel bus 72 to a first set of data gates 

The processor control circuit 70 responds to the sys- 80. The groups of six bit lines for each of the other 
tern clock signal, an image type signal (BINARY), an 15 neighborhood pixels are similarly coupled to other sets 
input valid signal (TVAL) and. an output ready signal of data gates 81-86. In the gray scale mode, when a 
(ORDY), applied externally to the morphological pro- neighbor pixel is selected to participate in the computa- 
cessor, by generating control and internal clock signals tion of the greatest gray scale value, the CPU 49 trans- 
fer the morphological processor 21. For example, the mits a byte on the processor data bus 59 which enables 
image type signal (BINARY) is employed to produce 20 independently the seven sets of data gates 80-86 in the 
the B/G internal control signal. In addition, the proces- greatest pixel circuit 76. When enabled, the data gate 
sor control circuit 70 uses the IV AL and ORDY signals sets 80-86, couple the pixel lines from the central pixel 
to generate an active BUSY signal as will be described bus 72 to a series of pixel comparators 77, 78, 79, 87, 88, 
hereinafter. and 89. Specifically, the first two sets of data gates 80 

Instead of processing a binary image, as described 25 and 81 couple the six data bit lines for two of the neigh- 
immediately above, the image processing system and borhood pixels to inputs of the first pixel comparator 77. 
specifically the morphological processors 21-23 can be The gray scale values for these two pixels are compared 
configured for a gray scale image. In this instance, the by the first comparator 77 which outputs the bits for the 
first memory 12 stores a six bit digital value of the lumi- pixel having the greatest luminance level. The other 
nance for each pixel of the image. The six bits for each 30 comparators 78, 79, and 88-89 similarly examine the 
pixel are read out of the first memory and onto bus 13. gray scale values of two input pixels and output the bits 
As shown in FIG. 3, the input buffer 20 is enabled in this for the greatest valued pixel. The output from the final 
mode to couple all of the lines of the data bus 13 to the comparator 89 in this greatest pixel circuit 76 represents 
LA input of the first processor 21. The six bit wide shift the neighborhood pixel having the largest gray scale 
registers 24 and 25 further couple the data bus lines to 35 value. This output is connected to one parallel data 
the LB and LC inputs of the same processor 21. With input of the ALU 66. 

reference to FIG. 4 and 5, each of the six. lines of the The lowest pixel circuit 75 is constructed similar to 
data bus 13 is connected to the LA input of a different the greatest pixel section 76, except that each of the 
one of the six neighbor selectors 30-35. The six bit lines comparators in the former section output the value of 
from the outputs of the first and second delay lines 24 40 the input pixel having the lower gray scale value, 
and 25 are similarly coupled to the neighbor selectors. Therefore, the output of the lowest pixel circuit 75, 
That is, the first selector 30 receives the most significant which is coupled to another parallel input of the ALU 
bit lines (bit 5) from the inputs LA, LB, and LC, the 66, represents the neighborhood pixel having the lowest . 
second selector 31 has the next most significant input bit gray scale value. In addition, a third ALU parallel data 
lines (bit 4) coupled to it, and so on. In the gray scale 45 input also receives the six data bits for the central neigh- 
mode, the selectors 30-35 respond to the BUSY and borhood pixel, that is the bits from the E flip-flop of 
PARITY control signals applied in parallel to their each neighbor selector 30-35. 

GBZ and GPAR inputs respectively. In response to Depending upon the configuration of the ALU 66, 

these control signals, the neighbor selectors 30-35 send one of the three input pixel values, (greatest, lowest or 
the pixel bits which correspond to the current neighbor- 50 central), can be directly coupled to its output 67. Alter- 

hood onto their output lines OB0-OB6 of their respec- natively, the ALU can be set up. to perform a mathe- 

tive pixel bus spur 50-55. For example, the first neigh- matic operation on these input pixel values. For exam- 

bor selector 30 outputs the most significant bits of the pie, the ALU can compute the arithmetic mean be- 

gray scale luminance values for the seven neighborhood tween the greatest and lowest gray scale pixel values 
pixels. 55 and apply the result to its output 67. The ALU 66 is 

The BUSY control signal GBZ causes the pipeline configured by commands fed into the CPU 49 from the 

processor control circuit 45 to reset selected flip-flops image processor's microcomputer 18 (FIG. 1). In the 

A-I when the central pixel is at the top or bottom image grey scale mode, all of the ALU output buffer amplifi- 

edge. Similarly, the control circuit 45 responds to the ers 68 and 69 are rendered conductive to produce a 
PARITY signal GPAR to reset other selected flip-flops 60 multi-bit output representing the transformation of the 

when the central pixel is at the beginning or end of a central pixel of each neighborhood. As the pixels are 

scan line. These signals produce an operation of the clocked through the morphological processor 21, each 

selector control circuit 45 which is similar to the binary one is transformed according to the conversion rule 

mode operation, except that since the neighbor selectors which is configured into the processor, 
are now operating in parallel, the delayed BUSY and 65 Referring momentarily to FIG. 3, the transformed 

PARITY signals from delay circuit 48 are not used. pixel values from the first morphological processor 21 

Referring again to FIG. 4, the look up table memories are serially coupled directly and by two shift registers 

60-65 are not utilized in the gray scale image processing 26 and 27 to inputs of the second morphological proces- 
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sor 22. The outputs of this second processor 22 are propagation delay is taken into account, data integrity 

similarly coupled to a third processor 23. Each of the may be lost. 

three morphological processors 21-23 can transform As shown in FIG. 1, the first and second memories 12 

the image using identical or different transformation and 15 on the input and output sides respectively of the 

rules depending upon their configuration by the user. 5 image processing pipeline 14 are linked by data flow 

Each of these transformations is idempotent if the control lines designated INPUT READY, INPUT 
resultant image is identical to the source image. In some VALID, OUTPUT READY and OUTPUT VALID, 
morphological operations, it is important to know if the These control lines into and out of the pipeline 14 are 
transformation is idempotent or not With continuing serially coupled through the morphological processors 
reference to FIG. 4, the idempotency is determined in 10 as illustrated in FIG. 3. Each morphological 
the gray scale mode by an accumulator (ACQ 73 sum- processor has an input which receives the input valid 
ming the transformed values of all of the pixels in the t0 that processor, from either first memory 
output image. If this pixel value summation is the same 12 or 30 easier morphological processor. This IV AL 
for the input and output images and the transformation signal indicates when the input data is valid and avail- 
is known to be monotonic, then the transformation is 15 able « If the morphological processor 21-23 is able to 
idempotent. receive data, an input ready signal IRDY is sent to its 

However, in the binary mode, there are six binary m P ut Similarly, each morphological pro- 

morphological transformation sections consisting of a cesser 21-23 emits an output valid signal OVAL when 

neighborhood selector and its corresponding look up _ ]t has da * *° L t0 ? d T CC f dreceivesa 

table memory in each morphological processor. There- 20 ° ut ? ut ? ev ?« signal ORDY when the subsequent 

fore, by merely looking at the summation from the de £ c * * * ble . t0 rcceive lh f output data, 

accumulator 73, there is no way of identifying which 7 depicts an example of a circuit 90 within the 

stage introduced the idempotency. In order to identify P rocessor , control circuit 70 for coupling these data 

which one of the binary inaage transformation sections „ " ow control signals between the devices upstream and 

introduced the idempotency, each look-up-table mem- 25 downstream from the morphological processor The 

««, T ' . r , . , input valid signal IVAL, indicating that the upstream 

ory«W5hasacircuit wb^ o^m vdue ^ m lhe ^ daU flow has * ata tQ $end P is CQn . 

of the ^ centra I pixel of each neighborhood (i.e the out- ^ ^ * . rf D ffi fl 9J ^ 

put of the E flip-flop) to the output value read from the Qther devices m ^ J tro] 70 . ^ q 

look-up-teble memory. When the morphological pro- 30 of ffi fl ^ lfid b § first AND £ 

cesser 21 is initialized at the beginning coprocessing iQ the 0VAL si ^ tenninal of ^ morphoIogical 

each image, a flag register within each of the look-up- processor . other input t0 ^ first AND gate 93 is 

table memories 60-65 1S set. If during the processmg of CQQnected t0 line 94 which receives a high level signal 

the image pixels the comparison of the central pixel when the ALU ^ has data t0 out t ^ out t vaJid 

value to its transformed value are unequal binary logic 35 si ^ OVAL will be onl when the j t valid 

levels, the flag m that look-up-table memory is reset. If si ^ IVAL is ^ve ^ the morphological processor 

at the completion of processmg the image the transfer- nas data t0 output> 

mation for a given transformation section was idempo- Similarly, the output ready signal ORDY indicating 
tent, its flag will remain set. If, however, the transfer- when tne next device in the data flow b ablc to receive 
mation was not idempotent in that any one pixel did not 40 data & coup icd to the data input of another flip- 
have the same transform value as its initial value, the flop 92 , The Q output of this flip-flop 92 is connected to 
flag will have been reset during processing. Therefore, ^ input of a secQnd AND gate 95 which has another 
at the termination of processing an image, the CPU 49 input connected to line 96 to which a high level signal 
addresses the look up tables memories 60-65 and reads \ s app ijcd when the morphological processor is able to 
their flag bits to determine which one, if any, had an 45 reC eive data. The clock signal inputs of these control 
idempotent transformation. flip-flops 91 and 92 receive the pixel rate clock signal. 

The image processing pipeline 14 can be formed by a As can be seen from FIG. 7, the input ready signal 

greater number of stages than just the three stages trdy is active only if both the ORDY signal is active 

shown in FIG. 3. It is important in such a pipeline that and the morphological processor is in a state where it 

should either the device feeding data into it or the de- 50 ^ receive data. 

vice receiving data from it become impaired, that the The operation of the processor control circuit 70 

pipeline halt its processing. The present system does not with respect to the inter-processor data flow control 

incorporate buffer memory, such as a first-in first-out signals is best understood with reference to the circuit 

memory, between stages. As a consequence, if one stage diagrams of FIGS. 3 and 7 and the control signal wave- 

of the pipeline continues processing while an adjacent 55 forms for gray scale image processing depicted in FIG. 

stage has halted, either erroneous data will be processed 8. At clock cycle "a" of FIG. 8, the microcomputer 18 

if earlier stages have halted, or data will be lost if later signals the CPLTs 49 in each morphological processor 

stages are stopped. Any mechanism for stopping the 21-23 to begin processing a new image. In response to 

pipeline when an input or an output device becomes the BEGIN signal pulse, each morphological processor 

impaired must halt the pipeline processing in an orderly 60 21-23 asserts an active low level BUSY signal on the 

manner to preserve data integrity. If the image process- next rising, or positive, clock pulse edge. The BEGIN 

ing pipeline is significantly long, merely applying a signal also causes the processors 21-23 to enter an ini- 

control signal at one end and allowing it to propagate in tialization phase which is approximately sixteen clock 

an undefined manner through the stages may not pro- pulses long during which time the processor registers, 

vide the requisite orderly control. The propagation. 65 flip-flops and data gates are placed in their initial states, 

delay of the halt control signal may result in remote The operation of the first morphological processor 21 

stages from the source of the signal continuing to pro- will be described in detail with the understanding that 

cess data after earlier stages have halted. Unless this the other processors 22 and 23 function in the same 
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manner. During the processor initialization phase, the (lop 91 to produce a high level OVAL signal enabling 

process control circuit 70 asserts low level IRDY and the next pixel (0,2) to be clocked out of the morphologi- 

OVAL signals which indicate to the adjacent devices cal processor 21. Therefore, whenever the input data is 

that it is not ready to receive or output data. unavailable, the HOLD signal goes low to freeze the 

At clock cycle b when the initialization phase tenni- 5 clocking of data through the processor so that invalid 

nates, the processor, control circuit 70 applies a high data bits are not introduced into the data stream, 

level to line 98 to set flip-flop 92 to ignore the ORDY At clock cycle j, the end of the second line of input 

signal since output data is not available. At the same . data is reached, and as occurred at clock cycle d, the 

time a high level is applied over line 96 to AND gate 95 input data, flow is halted for one clock cycle by a low 

asserting a high level active input ready signal IRDY 10 level IRDY signal. However, at this time, since data is 

which indicates to the first memory 12 that the morpho- still available for outputting, the OVAL signal is unaf- 

logical processor 21 is able to receive pixel data. How- fected and data continues to flow to the output receiv- 

ever, the first memory 12 is not ready to send data as ing device, which in this case is the second morphologi* 

indicated by a low level input valid signal IVAL. This cal processor 22. At clock cycle k, the end of the first 

low level IVAL signal causes the processor control 15 line in the output data occurs and a low level OVAL 

circuit 70 to emit an active low level HOLD signal. signal is asserted for one clock pulse to replicate the one 

When the first memory has data available at clock pulse cycle delay in the data flow that occurred at the end of 

c, its input valid signal IVAL goes high and the proces- the first line of input data (Le. at clock cycle d). 

sor control circuit 70 responds with an inactive high The output of the first pixel of the next line (pixel 1,0) 

level HOLD signal. Data for the first pixel (0,0) then is 20 commences on the next clock cycle. At clock cycle m, 

received at the LA input of morphological processor 21 the ORDY signal from the next morphological proces- 

. At this point, since the morphological processor 21 sor 22 in the pipeline goes low indicating that the next 

does not have data to output, the output valid signal at processor is not ready to receive additional data. Upon 

terminal OVAL still is low and the output ready signal this occurrence, the output from the ALU 66 is latched 

ORDY from the device which receives the output data 25 to continuously send the data representing the current 

continues to be ignored. pixel onto the output from the first morphological pro- 

For ease of explanation, assume that the image has cessor 22. The low level ORDY signal is also applied to 

only three scan lines of five pixels each. At clock cycle the data input of flip-flop 92 in FIG. 7. Upon the rising 

d, the data acquisition stops for one cycle at the end of edge of clock pulse n, the flip-flop 92 is clocked to 
the first scan line so that a parity signal change and 30 produce a low level signal at its Q output which causes 
other end of line events can occur. During this hiatus in the IRDY signal to go low as shown in FIG. 8. At this 
processing, the processor control circuit 70 asserts a time, the processor control circuit 70 also asserts a low 
low level IRDY pulse, by a low signal on line 96, which level HOLD signal to halt the clocking of pixel data 
stops the flow of data from the first memory 12. through the morphological processor 21. At this time, 

At clock cycle e, the data for the first gray scale pixel 35 the clocking of data through the components of the first 
has been transformed and propagated through the mor- morphological processor 21 is also halted. When the 
phological processor 21 becoming available at its out- ORDY signal again goes high at the beginning of clock 
put. Just prior to this clock cycle, the processor control pulse p, the next pixel (1,1) of output data is applied to 
circuit 70 sent a low level signal on line 98 enabling flip the output terminals of the morphological processor, 
flop 92 to respond to the output ready signal ORDY 40 However, at this time, a low level HOLD signal is still 
from the next processor 22. In addition, the processor being asserted and further pixel data are not clocked 
control circuit 70 sends a low level signal over line 94. through. At the next clock pulse q, the high level 
Since both inputs to AND gate 93 are now high, the ORDY signal is clocked through the second flip-flop 92 
output valid signal OVAL goes high signaling the next causing the IRDY signal to again go high removing the 
processor 22 that data is now available for it At this 45 low level HOLD signal and again activating the clock- 
time, that processor 22 is sending a high level ORDY ing of data through the processor, 
signal indicating that it is in a state to accept the data The end of the three lines of pixel data occurs at the 
from first morphological processor 21. beginning of clock pulse r which results in the IRDY 

One clock cycle later at clock cycle f, the first mem- . signal going low. At this point in time, the morphologi- 

ory 12 forces the input valid signal IVAL low indicat- 50 cal processor .21 becomes insensitive to the level of the 

ing that data is not presently available at its output In IVAL signal by the processor control circuit 70 sending 

response to the low level input valid signal, the proces- a low level on line 97 to set flip-flop 91. The remaining 

sor control circuit 70 immediately applies an active on portions of the second and all of the third scan lines of 

low level HOLD signal stopping the processing of the transformed pixel data are then outputted until clock 

pixels within each of the sections of the first morpholog- 55 pulse q when the end of the third output line occurs and 

ical processor 21, as well as stopping the input shift all data have been processed. At this point, an inactive 

registers 24 and 25. With reference to FIG. 7 on the next high level BUSY signal is asserted and the OVAL sig- 

rising edge of a clock pulse, the low level IVAL signal nal goes low indicating that output data is no longer 

is clocked through flip-flop 91 to produce a low level at available, 

the Q output This output produces a low level OVAL 60 As can be seen from the above description of the 
signal as shown during clock cycle g on FIG. 8. operation with respect to the handshake signals IVAL, 
During clock cycle h, the first memory 12 is again OVAL, ORDY, and IRDY, the present system pro- 
ready is send data to the morphological processor 21 vides an orderly manner in which the handshake signals 
and asserts a high level IVAL signal which produces are propagated through the image processing pipeline 
high level HOLD signal from the processor control 65 14. Specifically, the IVAL signal is applied to the out- 
circuit 70 allowing the processor to once again com- put of the morphological processor 21 one clock cycle 
mence operation. Upon the rising edge of the next clock after it is applied to the input Similarly, in the reverse 
cycle (i), the IVAL signal is clocked through the flip- direction, the ORDY signal from the next stage in the 
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pipeline is applied to the IRDY output of morphologi- 
cal processor 21 one clock cycle after it is received By 
providing a fixed delay in the propagation of the hand- 
shake signals and regulating the input and output data 
flows accordingly, an orderly control of the image 5 
processing pipeline 14 is achieved. This orderly control 
enables a significant number of morphological proces- 
sors 21, 22, 23, etc. to be cascaded together and allow 
the devices at the input and the output of the pipeline to 
stop the data flow as may be required without errone- ■ 
ous bits of data being inserted or data being lost because 
a receiving device was unprepared for the data. 
We claim: 

1. An image processing system comprising: 

a plurality of processing stages interconnected in a 
cascade manner, each of the stages for performing 15 
a morphological transformation of image data sup- 
plied to a data input of that respective stage and 
applying the results of the transformation to a data 
output of that respective stage, each stage compris- 
ing: 20 

a first data flow control circuit including a first input 
terminal for receiving a first signal indicating the 
availability of image data at the data input of the 
respective stage, means for delaying the first signal 
by a first given period of time, and means for cou- 25 
pling the delayed first signal to a first output termi- 
nal; 

a second data flow control circuit including a second 
input terminal for receiving a second signal indicat- 
ing the availability of a device connected to the 30 
data output of the respective stage to receive the 
transformed image data from that stage, means for . 
delaying the second signal by a second given per- 
iod of time, and means for coupling the delayed 
second signal to a second output terminal; and 

means for halting the morphological transformation 35 
of image data in response to the absence pf at least 
one of the first and second signals. 

2. The image processing system as recited in claim 1 
wherein said means responsive to the absence of at least 
one of the first and second signals halts the morphologi- 40 
cal transformation substantially immediately upon re- 
ceipt of the first signal. 

3. The image processing system as recited in claim 1 
wherein said means responsive to the absence of at least 
one of the first and second signals halts the morphologi- 45 
cal transformation after an interval of time substantially 
equal to the second given period of time from the re- 
ceipt of the second signal. 

4. The image processing system as recited in claim 1 
wherein the results of the morphological transformation 50 
applied to the data output of the stage are latched upon 
the halting of the morphological transformation which 

. occurs in response to the receipt of the second signal. 

5. The image processing system as recited in claim 1 
further comprising means for determining the idempo- 55 
tency of the morphological transformation performed 
by each stage. 

6. The image processing system as recited in claim 1 
wherein each stage further comprises as plurality of 
sections each of which processes a data bit from each 
pixel in a predefined group of pixels; means for connect- 60 
ing the plurality of sections in parallel to process a plu- 
rality of digital bits representing gray scale image data 
for each pixel or alternatively connecting the plurality 
of sections in series to perform of a plurality of morpho- 
logical transformations on each pixel bit of a binary 65 
image; and means for determining the idempotency of 
the morphological transformation performed by the 
stage. 



7. The image processing system as recited in claim 6 
wherein means of each stage for determining the idem- 
potency of a morphological transformation performed 
by the stage further comprises means for determining 
the idempotency of a morphological transformation 
performed by each section. 

8. An image processing system comprising: 

a plurality of processing stages interconnected in a 
cascade manner, each of the stages processing 
image data supplied to a data input of that stage and . 
applying the results of the processing to a data 
output of that stage, each stage comprising: 

a first data flow control circuit including a first input 
terminal for receiving a first signal indicating the 
availability of image data at the data input of the 
stage, means for delaying the first signal by a first 
given period of time, and means for coupling the 
delayed first signal to a first output terminal; 

a second data flow control circuit including a second . 
input terminal for receiving a second signal indicat- 
ing the availability of a device connected to the 
data output of the respective stage to receive the 
processed image data from that stage, means for 
delaying the second signal by a second given per- 
iod of time, and means for coupling the delayed 
second signal to a second output terminal; 

means responsive to the absence of at least one of the 
first and second signals for controlling the process- 
ing of image data; and 

each stage, except a last one in the cascade, also com- 
prising means for coupling the first output terminal 
to the first input terminal of a subsequent stage in 
the cascade, and for coupling the second input 
terminal to the second output terminal of the subse- 
quent stage. 

9. The image processing system as recited in claim 8 
further, comprising means for coupling the first output 
terminal and the second input terminal of a last stage in 
the cascade to the device connected to the data output 
of that last stage. 

10. The image processing system as recited in claim 8 
further comprising means for coupling the first input 
terminal and the second output terminal of a first stage 
in the cascade to a device connected to the data input of 
that first stage. 

11. The image processing system as recited in claim 8 
wherein said means responsive to the absence of at least 
one of the first and second signals halts the processing 
substantially immediately upon receipt of the first sig- 
nal. 

12. The image processing system as recited in claim 8 
wherein said means responsive to the absence of at least 
one of the first and second signals halts the processing 
after an interval of time substantially equal to the sec- 
ond given period of time from the receipt of the second 
signal. 

13. The image processing system as recited in claim 8 
wherein the results of the processing applied to the data 
output of the stage are latched upon the halting of the 
morphological transformation which occurs in response 
to the receipt of the second signal. 

14. The image processing system as recited in claim 1 
further comprising an interstage coupling means having 
a first means for connecting the data output of one stage 
to the data input of a subsequent stage in the cascade, a 
second means for connecting the first output terminal of 
the one stage to the first input terminal of the subse- 
quent stage, and a third means for connecting the sec- 
ond input terminal of the one stage to the second output 
terminal of the subsequent stage. 
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